Construction of Lyapunov Functions for Hybrid Piecewise-Deterministic Markov Processes
نویسندگان
چکیده
We present a method for the construction of Foster-Lyapunov functions to prove ergodicity of hybrid piecewise-deterministic Markov processes. Our method searches for the Lyapunov function that maximizes a measure of the rate of convergence that appears in the theory of large deviations. We provide conditions under which such a Lyapunov function is the limit of an iterative procedure. Analytical solutions are often possible as exemplified with a problem for which a Lyapunov function was not known before: the problem of controlling the probability density of a swarm of robotic agents.
منابع مشابه
Stability of switched stochastic nonlinear systems
Hybrid systems are digital real-time systems which are embedded in analog environment. Analog part of the hybrid system is described with differential equations and discrete part of the hybrid systems is an event driven dynamics which can be described using concept from discrete event systems (Cassandras & Lafortune, 2008) and (Tabuada, 2009). In this paper we will consider the switched systems...
متن کاملStability analysis for stochastic hybrid systems: A survey
This survey addresses stability analysis for stochastic hybrid systems (SHS), which are dynamical systems that combine continuous change and instantaneous change and that also include random effects. We reemphasize the common features found in most of the models that have appeared in the literature, which include stochastic switched systems, Markov jump systems, impulsive stochastic systems, sw...
متن کاملOn the Hamiltonian structure of large deviations in stochastic hybrid systems
We develop the connection between large deviation theory and more applied approaches to stochastic hybrid systems by highlighting a common underlying Hamiltonian structure. A stochastic hybrid system involves the coupling between a piecewise deterministic dynamical system in Rd and a time-homogeneous Markov chain on some discrete space Γ. We assume that the Markov chain on Γ is ergodic, and tha...
متن کاملEnlarging Domain of Attraction for a Special Class of Continuous-time Quadratic Lyapunov Function Piecewise Affine Systems based on Discontinuous Piecewise
This paper presents a new approach to estimate and to enlarge the domain of attraction for a planar continuous-time piecewise affine system. Various continuous Lyapunov functions have been proposed to estimate and to enlarge the system’s domain of attraction. In the proposed method with a new vision and with the aids of a discontinuous piecewise quadratic Lyapunov function, the domain of attrac...
متن کاملBisimulation for Communicating Piecewise Deterministic Markov Processes (CPDPs)
CPDPs (Communicating Piecewise Deterministic Markov Processes) can be used for compositional specification of systems from the class of stochastic hybrid processes formed by PDPs (Piecewise Deterministic Markov Processes). We define CPDPs and the composition of CPDPs, and prove that the class of CPDPs is closed under composition. Then we introduce a notion of bisimulation for PDPs and CPDPs and...
متن کامل